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Method for encoding wavelet coefficients 



(57) A method tor encoding wavelet coefficients can 
achieve a high compression ratio for image data The 
image date is converted and quantized into coefficients 
by a two-dimensional wavelet transform and the coeffi- 
cients having the same spatial position are collected to 
form a block. A layered quad-tree structure of the coeffi- 
cients included in each block is defined with respect to 
each da set of coefficients representing a vertical com- 
ponent (LH). a set of coeff icients representing a hori- 
zontal component (HL) and a set of coefficients 
representing a diagonal component (HH). Each quad- 
tree structure has a root corresponding to a coefficient 



of a lowest frequency band. A zero tree of which all 
descendant nodes lack a significant coefficient is 
searched for. and positional information of the zero tree 
is encoded. The coefficients other than descendants of 
the zero-tree are scanned so as to form a one-dimen- 
sional coefficient string of the scanned coefficients. The 
one-dimerwional coefficient string is encoded accorcfing 
to a two-dimensional encoding method using a run 
length of a zero run immediately preceding a significant 
coefficient and a significant coefficient 
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Description 

RACKGROUND QP THF INVENTION 

1. Field of the Invention 

[0001] The present invention generally relates to a 
method fa compressing image data such as data of a 
natural image and, more particularly, to a method for 
encoding image data such as a static image or a 
dynamic image by using a wavelet transform. 

2. Description of the Related Art 

[0002] Conventionally, a discrete cosine transform 
(DCT) « popular for compressing natural image data 
such as static image data or dynamic image data. Hew- 
ever, when encoding image data by using the DCT. a 
problem *ises in achieving a high compression ratio 
since there is an inherent deterioration in sU>jective 
image quality caused by generation of a block distortion 
a a mosquito noise. In order to eliminate such a prob- 
lem, various image encoding methods using a wavelet 
transform have been stuied 
[0003] A brief description will now be given erf the 
wavelet transform. A sub-band division shown in FKS.1 
can be performed on an analyzing side of a titer bank 
shown in FK3.2. On the analyzing side of the filter bank, 
image data is filtered by a tow-pass titer HO and a 2:1 
sub-sanping (i2) is performed in a horizontal drection. 
The processed image data is filtered by a high-pass fil- 
ter H1 in a horizontal direction and a 2:1 sU>-sampGng 
(i2) is performed in a vertical direction. An image is 
restored by processing the obtained frequency-band 
signals on a synthesizing side of the filter bank On the 
synthesizing side of the filter bank, a 2:1 ip-sampling 
(T2) and fitering by a low-pass filter F0 or a high-pass 
titer F1 are performed on each of the frequency band 
signals in a vertical ejection, and a 2:1 ip-sampling 
(T2) and fitering is performed by the lowpass fitter F0 
or the high-pass titer F1 in a horizontal direction. An 
encoding method in which a signal is cfivided into fre- 
quency bands is generally referred to as a sifc-band 
encoding. The encoding using a wavetettranstorm is 
regarded as a sub-band encoding as described below. 
[0004] In the wavelet transform, a multaayer band divi- 
sion is performed by repeating the above-mentioned 
sub-band division on a tow-band signal (a signal LL 
shown in FIG.1). Such a band division is referred to as 
an octave division. If a division is performed for three 
layers, ten sub-bands are obtained as shown in F1G3. 
In FIG.3, reference mjmerals 8 to 10 irricate suMands 
in the lowest layer, 5 to 7 indicate suthbands in the mid- 
dle layer, and 1 to 4 indicate sdfr-bands in the highest 
layer. 

[00051 The frequency-band signals obtained by the 
axjve-merrticned cfivision include signals (wavelet coef- 
ficients) LL LH. HL and HH as shown in FIG 1 or FIG.3. 



In FIG3, the signal LL 1 is a signal on a low-band side 
in both the horizontal and vertical directions. The signal 
LL 1 is obtained by filtering image data by a two-cfimen- 
sional low-pass filter (LPF). Hereinafter, the signal LL 
5 may be referred to as a Tow-band component* The sig- 
nals HL 3. 6 and 9 are obtained by filtering by a high- 
pass filter (HPF) in the horizontal direction and fitering 
by a low-pass titer in the vertical cfirection. An edge 
component in the vertical direction appears in the signal 
10 HL Hereinafter, this edge component may be referred 
to as a "vertical component" The signals LH 2. 5 and 8 
are obtained by filtering by a low-pass titer in the hori- 
zontal direction and filtering by a high-pass fffler in the 
vertical direction. An edge component in the horizontal 
r3 direction appears in the signals LH 2, 5 and 8. Hereinaf- 
ter, this edge component may be referred to as a "hori- 
zontal component* The signals HH 4, 7 and 10 are 
obtained by filtering by a high-pass fitter in both the hor- 
izontal direction aixl the vertical directs 
x ponent in a diagonal <f rection appears in the signals HH 
4, 7 and 10. Hereinafter, this edge component may be 
referred to as a "dagonai component - . 
[0006] It should be noted that in the wavelet transform, 
the above-mentioned titers are designed so as to sat- 
25 isfy a coalition for completely restoring a signal, that is, 
to satisfy an orthogonal condition and a normal condi- 
tion. Additionally, when a fitter having a nurnber of taps 
longer than the (fivkfing nurrtoer 2 in each band cfivision 
is used, a block cfistortion may be prevented since over- 
3c lapping of basic waveforms occurs. Further, as onlythe 
low band is repeatedly subjected to the band cfivision, a 
short* basic waveform is used as the f requen cy 
increases. Thus, it can be expected that a mosquto 
noise caused by a quantization cfistortion of a high-fre- 
35 quency component does not spread spatially. 

[00071 A description wffl now be given of a conven- 
tional method for encoring wavelet coefficients- Fust, 
each wavelet coefficient is quantized into a scalar quan- 
tity. The ^jantization process uses a linear quai .ti^aUw t 
40 for each band. Herein, an adaptive quantization in wheh 
the quantization process is witched for each band is 
not considered. The coefficients are encoded subse- 
quent to the quantization. As for the method for encori- 
ng, there is a method suggested in "9.6-Wtfs Picture 
45 Codng Using Wavelet Transform", a thesis of t he 1993 
Instituted Electronics. Information arKl Communication 
Engineers (IEICE) Spring Conference. D-262. 7-23. 
With respect to the quantized coefficients, one coeffi- 
cient is taken from one of the bands LLLH HLandHH 
so ri the highest layer (in a case of three-times cfivision). 
Four coefficients (2x2) are taken from each of the bands 
LH HL and HH in the irridcfle layer. Sixteen coefficients 
(4 x 4) are taken from each of the bands LH . HLandHH 
n the lowest layer. These coefficients are arranged in 
55 the same positional relationship so as to form an 8x8 
block shown in FIG.4. The sixty-four coefficients in the 
8x8 block are scanned in an order shown in FIGS so as 
to obtain a one-dimensional string of coefficients Then, 
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the coefficients are subjected to a two-dmensional 
Huffman encoding with [run length of zero run. signifi- 
cant coefficient]. However, only the DC component (LL 
coefficient of the highest layer) is subjected to a DPCM. 
As is apparent from FH3.5. the scanning is performed 5 
from the highest layer toward the lowest layer. In the 
same layer, the canning is performed in the order of the 
vertical corrponent (HL). the horizontal component (LH) 
and the diagonal corrponent (HH). Additionally, the ver- 
tical conponents are scanned in the vertical direction. 10 
the horizontal components are scanned in the horizon- 
tal direction and the diagonal components are zigzag 
scanned. 

[0008] Additionally. "Wavelet Transform Coding for 
Picture (2) -A Scanning Method suitable for Wavelet is 
Basis-', a thesis of the 1993 Institute of Electronics. 
Information and Communication Engineer (IEICE) 
Spring Conference. D-336. 7-46. discloses another con- 
ventional method. In this method, 8x3 coefficients m a 
block are formed in a quad-tree structure by forming a 20 
single node by three coefficients (LH. HU HH) located in 
the same spatial position i n each layer, and scanning for 
a sub-tree is stopped at EOS (end of sub-tree) code. 
The node in the quad tree is scanned by a depth-first 
method, are! is encoded as a one*fimensional stnng of 25 
the EOS or coefficients. 

(0009] The conventional method descrfoed with ref er- 
ence to FCL5 is wdl adapted to the method in which the 
OCT coefficients in a 8x8 pixel block are zigzag 
scanned to form a one-dimensional coefficient string » 
and the coefficient string is encoded by the twonjimen- 
sional Huffman encoding with [run length of zero run. 
significant coefficient]. However, this method is not 
always suitable tor a characteristic of the wavetet trans- 
form coeffkaent In a case in which the DCTcoeffid^ » 
are zigzag scanned, coefficients corresponcfing to fre- 
quency components in the same area (8x8) are 
scarred in a direction from a lower frequency to a 
higher frequency. Accordingly, energy is concentrated 
into a low- frequency corrponent. and a large significant <o 
coefficient appears in the low-frequency component On 
the other hand, a frequency of appearance of zero is 
increased on the high-frequency side, and a number of 
small significant coefficients is increased Thus, a large 
number of short zero runs tend to appear and a small 45 
number of long zero runs tend to appear on the high-fre- 
quency side. According to such local concentration m 
appearance of 2ero run lengths, a number of objects to 
be encoded is decreased, and an amount of data can 
be decreased. 50 
[0010] Also in the 8*8 btock coefficients by the wavelet 
transform, the same tendency can be expected. How- 
ever, since the 2x2 or 4x4 coefficients in each of the 
second and third layws are spaliafly adjacent to each 
other an expected value of the coefficient is not 55 
decreased as the scanning progresses. Accordingly, as 
compared to the case of DCT coefficients, the signifi- 
cant coefficients do not always elective* appear in the 



beginning of the scanning. Rather, the signficant coeffi- 
cients are spatially maldistributed. That is, in each of the 
second and third layers, the zero coefficient tends to 
appear in a portion lacking energy of a directional com- 
ponent On tfie contrary, in each of the second and third 
layers, the significant coefficient tends to appear in a 
portion having energy of a directional component. 
Accordingly, when a scan is performed from a higher- 
order position to a lower order position as is in the con- 
ventional method, an area in which significant coeffi- 
cients are present is traversed in the second and third 
layers Accordingly, a relatively tong zero run tends to 
frequently appear in the second and third layers. Thus, 
an effect of data compression due to zero runs appear- 
ing in a particular area is reduced. 
[00111 Additionally, in the wavelet transform, each of 
the vertical and horizontal edges in an image has a 
large significant coefficient in the correspondng direc- 
tion thereof, and a directional component of a direction 
other than the correspondng air actions of the edge 
rarely appears. In such a case, if scanning is performed 
in a cfrection from a higher position to a lower position 
without separating in each olrectfonal component, that 
is. if the coefficients in the same layer are scanned, for 
example, in the horizontal direction, the vertical direc- 
tion and a olagonal direction, in that order, the scanning 
is performed by traversing a dredional component hav- 
ing a srral number of significant coefficients and a 
cfirecbonal corrponent having a large number of signifi- 
cant coefficients. Thus, a small number of long zero 
runs and a large number of short zero runs do not 
appear but a relativ^y long zero run frecjjerrtly appears. 
This may decrease an encoding efficiency. 
[0012] m the conventional method descrtoed with ref- 
erence to FK3L6, the 8x8 coefficients are formed in a 
quad-tree structure, and seaming ts performed by a 
depth-first method. Accordingly although spatially local- 
ized significant coefficients are not traversed, the scan- 
ning is performed by traversing significant coefficients 
that toca&ze in different directional compone nts. ^ 
[001 3] Additionally, in both conventional methods, the 
coefficients in the second and third layers are 2x2 and 
4x4 coefficients spatially adjacent to each other, 
respectively. Thus, a pattern having a strong correlation 
appears in a olrectfon of each drectional component 
However, if a one^fimensional scan is performed, the 
above-mentioned nature may not be efficiently uHized. 



SUMMARY OF T "f INVENTION 

[00141 It is a general object of the present invention to 
provide an improved and useful method tor encoolng 
wavelet coefficients in which the above-mentioned 
problems are eliminated. 

[00151 A more specific ofajed of the present invention 
is to provide a method for encoring wavelet coeff icients 
wftch can achieve a high compression ratio for image 
data. 
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[0016] In oider to achieve the above-mentioned 
objects, there is provided according to the present 
invention a method for encoding wavelet coefficients in 
an image encoding method in which image data is con- 
verted and quantized into coefficients by a twodimen- 5 
sional wavelet transform and the coefficients having the 
same spatial position are collected to form a block so as 
to encode the coefficients on an incfividual block basis, 
the method comprising the steps of: 



70 

defining a layered quad-tree structure of the coeffi- 
cients included in each btock with respect to each of 
a set of coefficients representing a vertical compo- 
nent, a set of coefficients representing a horizontal 
conponent and a set of coefficients representing a 15 
diagonal conponent. each quad-tree structure hav- 
ing a root corresponding to a coefficient of a lowest 
frequency band; 

searching for a zero tree of which all descendant 
nodes lack a significant coefficient; x 
encoring positional information of the zero-tree; 
scanning the coefficients other than descendants of 
the z»o tree so as to form a one-dimensional coef- 
ficient string of the scanned coefficients; and 
encoding the one-dimensional coefficient string 25 
according to a two-cfimensional encoding method 
using a run length of a zero run immediately pre- 
cecfing a sptficant coefficient and the significant 
coefficient 

x 

[0017] Acceding to the above-mentioned invention, 
only the coefficients other than the descendants of the 
zero tree are scanned to form the one<f mensional 
coefficient string by utiizing the fact that the coefficients 
forrnng a block have a layered quad-tree structura * 
Thereby, a run length of a zero run can be shorter than 
that of a case in which all non-significartcoeTidentsare 
seamed. Thus, a compression ratio is increased. Addi- 
tionally, even if an over head of a sub-tree which does 
not tndude a significant coefficient is generated, the *o 
non-siyiificant coefficients can be efficiently repre- 
sented by the zero-tree method rather than a method 
with a combination of a code indicafing a predetermined 
nurrt>er of zero runs corresponcfing to a respective leveJ 
and a nunfoerof remaining zeros. 45 
[0018] AdcftonaJty, the method according to the 
present invention may further comprise the steps of: 

producing a zero-tree map having a layered quar- 
tered-tree structure corresponcfing to the coefficient sc 
tree, each node of the zero tree map indicating 
whether or not a corresponding coefficient is a root 
of the zero-tree, each node being represented by 
one-bet data: 

scanning the zero-tree map acco r d in g to a depth- ss 
first method so as to change the zero tree map into 

a on*dimensional string of the nodes; and 
producing encoded data of the positional informa- 



tion of the zero-tree map by encoding the one- 
cfimensional string of the nodes. 

[001 9] According to this invention, the positional infor- 
mation of the zero-tree can be efficiently encoded 
[0020] Additionally, in the above-mentioned invention, 
the one^fimensional string produced from the zero-tree 
map may be encoded by a run length encoding method. 
Since "1 " frequently appears when the one-cfimensional 
string is produced from the zero-tree map. an encoding 
can be efficiently performed by the run length encoding 
method. 

[0021] Addtionally, in the scanning step of the present 
invention, the coefficients other than descendants of the 
zero-tree may be scanned separately in each of the set 
of coefficients representing the vertical component the 
set of coefficients representing the horizontal compo- 
nent, and the set of coefficients representing the diago- 
nal component on a depth-first method 
[0022] Accordingly, a frequency of appearance of a 
relatively long zero run due to spatial localization of sig- 
nificant coefficients in each level can be reckiced. 
Thereby, an efficiency of encocfing can be increased. 
[0023] AdcftionaDy. the set of coefficients representing 
the vertical component may be scanned in an order of 
upper left lower left upper right and lower right the set 
of coefficients representing the horizontal component 
may be scanned in an order of upper left, upper right 
lower left and lower right, and the set of coefficients rep- 
resenting the diagonal component may be scanned in 
an order of upper left lower right upper right and lower 
left 

[0024] In this invention, a scanning for each level is 
performed in a direction toward a position having a 
strong correction. Thus, significant coefficients that are 
^atialy localized can be coflectivefy scanned which 
nproves an encocfing efficiency. 
[0025] Addtionally, there is provided according to 
another aspect of the present invention a method tor 
encoding wavelet coefficients in an image encoding 
method in which image data is converted and quantized 
iito coefficients by a ttwniimensional wavelet transform 
and the coefficients having the same spatial position are 
collected to form a block so as to encode t he coeff i- 
cients on an incfividual block basis, the method compris- 
ing the steps of: 

definkig a layered quad-tree structure of coeffi- 
cients irctuded in the block with respect to each of 
a set of coefficients representing a vertical compo- 
nent a set of coefficients representing a horizontal 
conponent and a set of coefficients representing a 
diagonal component each quad-tree structure hav- 
ing a root corresponding to a coefficient of a lowest 
frequency band; 

searching tor a zero tree of which all descendant 
nodes lack a significant coefficient; 
scanning the coefficients other than descendants of 
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the zero tree according to a depth-first method, a 
scanning being separately performed for each of 
the set of coefficients representing the vertical com- 
ponent the set of coeff irients representing the hor- 
izontal component and the set of coefficients 5 
representing the cfiagonal component; 
producing a coefficient vector by using four coeffi- 
cients of each node of each quad-tree structure and 
producing an EOS code at a root of the zero tree so 
as to produce a string of the coefficient vectors and 10 
the EOS codes; and 

encoding the string of the coefficient vectors and 
the EOS codes by a variable length encoding 
method. 

15 

[Q026] Accordngry, a spatial correlation of four coeffi- 
cients is utiBzed and, thereby, an efficient encocfing can 
be performed. 

[00271 Additionally, the set of coefficients representing 
the vertical component may be scanned in an order of 20 
upper left lower left upper right and lower right, the set 
of coefficients representing the horizontal component 
may be scanned in an order of upper left upper right 
lower left and lower right; and the set of coefficients rep- 
resenting the diagonal component may be scanned in 25 
an order of upper left tower right upper right and lower 
left 

[0Q28] to this invention, a scanning for each level is 
performed in a direction toward a position havmg a 
strong correlation. Thus, significant coefficients that are 30 
spatially locafized can be collectively scanned, which 
improves an encocfing eff iciency. 
[0029] Additionally, in the encocfing step, the string of 
the coefficient vectors and the EOS codes may be 
ad**veiy traded by a variable length encoding 35 
based ona dass of a degree of a value of a coefficient 
conehpond in g to a parent coefficient of the coefficient 
vectors or the EOS code to be encoded. 
[0030] Accordingly, a correlation between a parent 
coefficient and tour child coefficients is utilized and. 40 
thereby, an efficient encoding can be performed. 
[0031] Additionally, in the encocfing step, the string of 
the coefficient vectors and the EOS codes may be 
adoptively woded by a variable length encoding 
based on a level of a frequency band in which the coef- 45 
fibent or the EOS code to be encoded is located. 
[0032] Accorcfingly. a correlation between the coeffi- 
cients and the level of the frequency band is utilized 
and. thereby, an efficient encoding can be performed. 
[0033] Additionally, in the encocfing step, the string of so 
the coefficient vectors and the EOS codes may be 
ad*rtivery encoded by a variable length encoding using 
a coronation of a coefficient vector induding a signifi- 
cant coefficient or an EOS code and a number of the 
coeff idem vectors each of which lack a significant coef- 55 
fioent 

[0034] According to this invention, since a vector of 
which afl coefficients are non-significant coefficients 



other than descendants of the zero-tree are encoded as 
a number of consecutive vectors, a number of vectors to 
be encoded is decreased which improves an encocfing 
efficiency 

[0035] Other objects, features and advantages of the 
present invention win become more apparent from the 
following detailed description when read in conjunction 
with the accompanying drawings. 



BP IPF DESCRIP TION flF TH P DRAWINGS 
[0036] 

F1G.1 is an illustration for showing a two-cfimen- 
sional sub-band division; 

FIGl2 is a diagram of a filter bank for a two-dimen- 
sional wavelet transform; 

FIG3 is an illustration for showing an octave <fivi- 
sion with three layers; 

FIG.4 is an illustration of a block including 8x8 coef- 
ficients; 

FIG. 5 is an illustration for showing an order of scan- 
ning tor coefficients in a block by a conventional 
method; 

F1G6 is an illustration for explaining a conventional 
method using a quartered-tree structure and an 
EOS code; 

FIG. 7 is an illustration shewing a conventional zig- 
zag scanning of coefficients in a block; 
F1G.8 is a flowchart of an entire process for encod- 
ing 91 image accordng to the present invention; 
RG.9 is a flowchart of a coeff went encoding proc- 
ess accordng to a first embodiment of the present 
invention; 

F1G.10A is an illustration for explaining a process 
for producing a quad-tree structure; FIG. 1GB is an 
illustration for explaining a zero-tree map; 
FIG. 1 1 is an illustration for explaining a one-dimen- 
sional scanning of the zero-tree map shown in 
F1G.10; 

FIG. 12 is an illustration tor showing an order of 
scanning of 8x8 coefficients shown in FIG10A; 
FIG.13 is a flowchart of a coefficient encoding proc- 
ess accordng to a second embodiment ct the 
present invention; 

F1G.14 is a flowchart of a coefficient encocfing proc- 
ess accoctfing to a third embocfiment of the present 
invention; 

FIG 15 is a flowchart of a coefficient encoding proc- 
ess according to a tourth embodiment of the 
present invention; 

FIG 16 is a flowchart of a coefficient encoding proc- 
ess accordng to a fifth embodiment of the present 
invention; 

FIG. 17 is an illustration of a string of coefficient vec- 
tors and EOS codes produced by 8x8 coefficients 
shown in FIG.10A in the second embodiment; 
Fig. 18 is an illustration of a string of coeff icient vec- 



c 



EP0926896A2 



10 



tors and EOS codes produced by 8x8 coefficients 
shown in FIG.10A in the third embodiment; 
FK3.19 is an illustration of a string of coefficient vec- 
tors and EOS codes produced by 8x8 coefficients 
shown in FIG.10A in the fourth embocfiment; 
FIG.20A is an illustration for explaining a process 
for producing a quad-tree structure; FIG.20B is an 
illustration for explaining a zero-tree map; and 
FIG.21 is an illustration shewing a string of a 
number of consecutive non-significant coefficient 
vectors and significant coefficient vectors or EOS 
codes when encoding 8x8 coefficients shown in 
FK3.20A in the fifth embodiment. 

ftPTAILED DESC RIPTION OF THF PREFERRED 
EMBODIMENTS 

[0037] A description wiO now be given of embodiments 
of the present invention 

[0038] FIG8 shows a flowchart of an entire process 
for encoding an image according to the present inven- 
tion. In step S1 . image data is subjected to a twodimen- 
sional gavelet transform process. In step S2. the 
dbtained wavelet coefficients are quantized. The quan- 
tized coefficients are formed in a bock in step S3, and 
are encoded on a block unrt basis in step S4. 
PXJ39] The present invention is related to the coeffi- 
cient encoding process step S4. and the wavelet trans- 
form step S1. the coefficient quantization step S2 and 
the block-cutout step S3 may be the same as that per- 
formed in the conventa^m 
will be given below of only the coefficient encoding proc- 
ess step S4. tt should be noted that the description 
below is based on the assumption that a size of the 
bio* of the coefficients is 8x8 (-2**2?). However, the 
present invention is applicable to a general case in 
whichanuntwoflayersforab^ 
and the size of the block is set to 2**2". 

(First EmbocSment) 



[0040] F1G9 is a flowchart of the coefficient encoding 
process step accorcfing to the first embodiment <* the 
present invention. 

[00411 The 8x8 coefficients in a block have a quad- 
tree structure having three layers tor each of the compo- 
nents LH. HL and HH as shown in F1G.10A. Addtkxially, 
if the IX conponent is regarded as a parent and the 
other three coefficients LH. HL and HH in the highest 
layer are regarded as children, a quad-tree structure 
having tour layers is obtained (only the highest layer is a 
thchotomous tree). 

[0042] In step S10 of FKo.9. a zero tree (descendants 
thereof are al zero) is searched for with respect to the 
quad-tree structure of 8x8 coefficients so as to produce 
a zero-tree map. Specifically, the quad-tree structure of 
8x8 coefficients is searched for on a depth priority basis 
from the LL coefficient in the highest layer, that is, the 



third level. If there is a node whose descendants are all 
zero coefficients (non-significant coefficients), zero "0" 
is set to a position corresponding to that node. On the 
other hand; if at least one of the descendants is a signrf- 
s icarrt coefficient one m V is set to the position of that 
node. Since the nodes in the level zero, that is. the low- 
est layer, do not have descendants, the search is per- 
formed until the layer that is one layer above the lowest 
layer. Thus, a 18-bit zero-tree map shown in FK3.10B is 
,o produced with respect to the quad-tree structure of the 
8x8 coefficients shown in FIG.10A. 
[0043] In step S1 1 , the zero-tree map (quartered tree) 
is searched tor according to the depth-first method start- 
tig from a root (a node corresponding to the LL coeffi- 
i5 cientof the level 3) so as to change the zero-tree map to 
a one-<fimensional binary string. SpecTically. starting 
from the root ftst a node corresponding to the vertical 
conponent of the level 2 is searched for. If that node is 
one the tour children (corresponding to the 2x2 
20 coefficients of the vertical component of the level 1) are 
vertically scarred in the order of upper left lower left, 
upper right art lower left Thereafter, the search pro- 
ceeds to a node cot responding to the horizontal compo- 
nent of the level 2. rf that node is one "1", the four 
2$ children (corresponding to the 2x2 coefficients of the 
horizontal conponent of the level 1) are horizontally 
scanned in the order of upper left, upper right lower left 
and lower nght Thereafter, the search proceeds to a 
node corresponds to the diagonal component of the 
x level Z H that node is one 1*. the four (rtldren (corre- 
spondhg to *e 2x2 coefficients of the cfegonal compo- 
nent of the levell) are horizontally scanned in the order 
of upper left tower right upper right and tower left ft 
should be noted that if a node set to zero "0* is reached 
35 during the search, this means that al the descendants 
thereof are zero and information regarding the children 
s not needed. Thus, the search does not proceed to the 
children of the node set to zero "0". * the case of the 
zero-tree m*> shown in FK3.10B. the search is per- 
4c formed along a route shown in FIG.11. and a one- 
timensiond srtig [1 1 1 1 1 0 1 1 1 1 1 01 is obtained . 
pott] tn step S1 2, the thus-obtained one dimensional 
string of the zero-tree map is encoded by a run-length 
encodng so as to produce encoded data of the pos- 
45 ttonal infu m as on of zero trees As seen in the above- 
mentioned example, since the node set to one *r (non- 
zero-tree) appears more frequently than the node set to 
zero "0". orty consecutive numbers precedng zero "0" 
areefroledbyavariabMen^ 
so 100451 In step S13. a oneKfimensional coefficient 
string is produced by scanning the coefficients other 
than descendants of zero-trees. Specifically, the zero- 
tree map is traced in the same route 
cfimension^ string while tracing the corresponrfng coef- 
55 fcents in the quartered tree so as to scan the coeff'h 
dents accortfing to a depth-first method until the 
coefficients of the level 0 are reached- When a node set 
to "0" is reached, the descendant coefficients thereof 
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are not scanned. An order of scanning for four children 
is the same as that when the zero-tree map is changed 
into the onedimensional string. That is. the order of 
scanning for four children is the order (vertical scanning) 
of upper left, lower left upper right and lower right for 5 
the vertical corrponent; the order (horizontal scanning) 
of upper left, upper right lower left and lower right for 
the horizontal scanning; and the order (diagonal scan- 
ning) of upper left lower right upper right and lower left 
for the diagonal scanning. w 
[00461 Fa example, in the case of 8x8 coefficients 
shown in FK3.10A. the coefficients are scanned in the 
order of nurrtoers 1 to 40 in FK5.12. That is> the coeffi- 
cients are scanned in the order of: the LL coefficient d 
the level 3 -> the HL coefficient d the level 2 the 15 
upper-left HL coefficient of the level 1 -* vertical scan- 
ning of the 2x2 HL coefficients d the level 0 -> the 
lower-left HL coefficient of the level 1 -> vertical scan- 
ning of tie lower-left 2x2 HL coefficients of the level 0 -> 

►the W concent of the level 2 -> the i^er-left 20 

LH coefficient of the level 1 -> horizontal scanning of the 
2x2 LL coefficients of the level 0 ^ the upper-right LH 
coefficient of the level 1 horizontal scanning of the 

upper right 2«2 LH coefficients of the level 0-> ► 

horizontal scanning of the lower right 2x2 LH coeffi- 2$ 
cents of the level 0 the HH coefficient of the level 2. 
Since the HH coefficient of the level 2 is a root (*) d a 
zero tree, the scanning does not proceed to its 
descendants and the scanning is ended. Additionally. 
Since the lower-right HL coefficient d the level 1 is also 30 
a root O d a zero tree, the scanning does not proceed 
to its descendants and the scanning proceeds to the LH 
coefficient d the level 2. Accordingly, the 8x8 coeffi- 
cients shown in FIG.10A are changed to a one-dimen- 
sional coefficient siring. "560. -48. -48. Q* 80, 16. - * 
48 0 -16. 0. 0, 0. -16. 0. 0. 0. 0. -96. 144. 32. 64. -16. - 
32, -16. 16. 0. 0. -16. -32. 0. 16. 0. 0. 0. 0. 16. 16. 0. 80/ 
P047] m step S14, a two-tfmensonal Huffman 
encoding is performed on the one«fimensional coeffi- 
cient string obtained in the previous step with [run <o 
length d zero run immediately preceding significant 
coefficient significant coefficient so as to produce 
encoded data d the coefficients. It should be noted that 
the encoding metrcd itself is the same as that d the 
conventional method. 45 
[0048] In the case d 8*8 coefficients shown in 
FIO20A, the zero-tree map is searched for in an order 
as shown in FIG20B. and a one<imensional string 
[11111011111110001 is obtained. The 8x8 coefficients 
shown in F1G20A are Afferent from the 8x8 coefficients so 
shown in FK3 10A in that the i^per-left coefficient 
among the 2x2 HH coefficients d the level 0 is a signif- 
icant coefficient Accordingly, the HH coefficient d the 
level 2 is not a root d a zero tree, and the chddren d the 
HH coefficient d the level 2 are searched for. Thus, the 55 
three HH coefficients and one HL coefficient provided 
with marks ' are roots d zero trees. Therefore, the 8*8 
coefficients shown in FK3.20A are changed into a one- 



dimensional coefficient string. "560. -48. -48, -48. 0. 80. 
16. -48. 0. -16. 0. 0. 0. -16. 0. 0. 0. 0. -96. 144, 32. 64. - 
16. -32.^16. 16. 0. 0. -16. -32. 0. 16. 0. 0. 0. 0. 16. 16. 0. 
80. 0. 16. 0. 0. 0. 0. 0. or 



( Second Embodiment > 

[0049] FIG.13 shows a flowchart d a coefficient 
encocfing process according to a second embodiment d 
the present invention. 

[0050] A zero-tree map d the 8x8 coefficients is pro- 
duced in step S20. This process is the same as that d 
the step S10 d the above-mentioned first embodment 
and a descrfction thered wifl be omitted. In the present 
errtxxSment. the encoding d the zero-tree map is not 
performed This is because the positional information 
regarding the zero-tree map is encoded as a form d 
EOS (end d sdtMree) code together with the coefficient 
information. 

[0051] In step S21. the zero-tree map is referred to 
and the quad tree d the 8x8 coefficients is searched for 
by each d the horizontal components, the vertical com- 
ponents and the diagonal components, in that order. 
Four coefficients corresponding to children d a node 
other than a root da zero tree are scanned. At this time, 
a vertical scanning is performed for the vertical compo- 
nent a horizontal scanning is performed for the horizon- 
tal conponent and a dagonal scanning is performed for 
the diagonal cfirection. The obtained four coefficients 
are rearranged in the order d scanning so as to pro- 
duce a four-dmensional vector. Coefficients corre- 
sponding to children d a node correspondng to a root 
d a zero tree are not scanned, and the EOS code is 
produced so that a one-dimensional coefficient string in 
which the coefficient vectors and the EOS codes are 
rearranged in the searched order is obtained. However, 
since the nurrfcer d the coefficients d the level 2 that 
are children d a root is three, a three-dimensional vec- 
tor is exceptionally produced by tiese coefficients. 
AdcrtonaQy. coefficients other than zero trees are 
changed into a vectored if the to all 

zero. 

[0052] For exanple. in the cased the 8x8 coefficients 
shown in FK3.10A. the three coefficients d the level 2 
are changed into a vector. At this time, all components 
are exceptional handled together. Thereafter, the ver- 
tical coiTponertts are searched for, and the 2x2 HL coef- 
ficients d the level 1 are vertically scanned and 
changed into a vector. Additional the i^per left 2x2 
HL coeffcients, the lower-left 2x2 HL coefficients and 
the upper right 2x2 HL coefficients d the level 0 corre- 
spondng to children d the 2*2 HL coefficients d the 
level 1 are vertically scanned in that order, and are 
changed into respective vectors However, since the 
lower right HL coefficient among the 2x2 HL coefficients 
d the level 1 is a root d a zero tree the EOS code is 
produced and the children, that is. the tower-right 2x2 
HL coefficients d the level 0. are not scanned. Thereaf- 
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ter, a search for the horizontal components is started by 
the 2x2 HC coefficients of the level 1 being horizontally 
scanned and changed into a vector. Then, the search ts 
shifted to the diagonal components. However, since the 
HH coefficient of the level 2 corresponds to a root of a 
zero tree, the HH coefficients of the level 1 correspond- 
ing to the descendants of the HH coefficient of the level 
2 and the HH coefficients of the level 0 are not scanned 
and the EOS codes are produced so as to end the 
search. Accordingly, a one-dimensional coefficient 
string comprising the coefficient vectors and the EOS 
codes shown in FIG.17 is obtained. 
[0053] In step S22, a variable length encocfing is per- 
formed on the coefficient strings produced in the previ- 
ous steps comprising the coefficient vectors and the 
EOS codes so as to produce encoded data of the coef- 
ficients and the positional information of zero trees. It 
should be noted that the vector produced by the three 
coefficients of the level 2 is encoded by an encoding 
method different from thai used on the vectors produced 
by four coefficients. 

(Third Embodiment) 

[0054] FIG. U shows a flowchart of a coefficient 
encoding process accordng to a third embodiment of 
the present invention. 

[0055] A zero-tree map of the 8*8 coefficients is pro- 
duced ii step S30. This process is the same as that of 
the step S10 of the above-mentioned first embedment 
and a description thereof win be omitted. In the present 
emboo%nent. since the positional information of a zero 
tree is encoded together with the coefficient information 
similar to the Aove-mentioned second embedment 
the zero-tree map is not encoded. 
[0056] In step S31. a one<imensional string compns- 
ing the coefficient vectors and the EOS codes is pro- 
duced with respect to the 8x8 coefficients in a similar 
maimer as step S21 of the above-mentioned second 
errtxxJiment The process of step S31 is different from 
the process of step S21 only in that in the process of 
step S31. the coefficient vector or the EOS code is pro- 
vided with class Wormation regaidfrg a coefficient 
value correspontfing to a parent thereof. The class of 
the confident value is assigned, tor example, as shown 
in the foflowing Table 1. 



Table 1 (continued) 



to 



Coefficient Value 


Class 


-31, • ••,-16.16, • • *. 
31 

• 
• 
• 


5 
• 

• 



Table 1 


Coeffident Value 


Class 


0 


0 


•1. 1 


1 


•3. -2,2.3 


2 


-7. • • -4.4. • • •. 7 


3 


-15, 8. • • v15 


4 



[0057] For example, in the case of the 8x8 coefficients 
shown in FIG.10A, the one^limensional string compris- 
ing the coefficient vectors and the EOS codes provided 
w with the class information is produced as shown in 
FIG.18. 

[0058] In step S32. the coefficient vector or the EOS 
code included *i the one-dimensional string produced in 
the previous step ts subjected to a variable length 
so encoding adaptively on each individual class basis. 
That is. the varidDle length code is designed for each 
dass, and encocfing is performed by using the variable 
length code. Although the Huffman encoding method 
may be used for encoding, other variable length encod- 
25 ing methods may be used, if necessary. 

(Fourth ernbocfiment) 

[0059] FK3.15 shows a flowchart of a coefficient 
x encodfcg process accord ng to a fourth embodiment of 
the present invention. 

[0060] A zero-tree map of the 8x8 coefficients is pro- 
duced in step S40. This process is the sameasthat of 
the step S10 of the above-mentioned first enrtoxOment. 
» and a desenption thereof wfll be omitted. In the present 
embodiment since the positional information of fazero 
tree is encoded together with the coefficient information 
similar to the above-mentioned second embodiment, 
the zero-tree map is not encoded 
<o [0061] In step S41 . a one-dimensionaJ string compns- 
hg the coefficient vectors and the EOS codes is pro- 
duced with respect to the 8x8 coefficients in a sonJar 
manner as step S21 of the above-mentioned second 
embodiment The process of step S41 is different from 
45 the process of step S21 only in that in the process of 
step S41 , the coefficient vector or the EOS code is pro- 
vided with Wormation regarding a level d a frequency 
band in which the coefficient or the EOS code s 
located. For example, in the case of the 8x8 co efficien ts 
50 shown in FK110A, the one-dimensional string compris- 
tog the coeffident vectors and the EOS codes provided 
with the level information is produced as shown in 
FIG19. 

[0062] In step S42. the coeffident vector or the EOS 
55 code induded in the one-cfimensional string produced in 
the previous step is subjected to a variable length 
encodng adaptively on each individual level basis That 
is. the variable length code is designed for each level. 
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and encoding is performed by using the variable length 
code. Although the Huffman encoding method may be 
used for encoding, other variable length encoding meth- 
ods may be used, if necessary. 

( Bfth Embodiment) 



[00631 FIG.16 shows a flowchart of a coefficient 
encoring process according to a fifth embodiment of the 
present invention. 

[0064] A zero-tree map of the 8x8 coefficients s pro- 
duced in step S50. This process is the same as that of 
the step S10 of the above-mentioned f irst embedment 
and a description thereof will be omitted. In the present 
embedment, since the positional information of a zero 
tree is encoded together with the coefficient information 
similar to the above-mentioned second embodiment 
the zero-tree map is not encoded. 
[0065] In step $51 . a one-dimensional string compris- 
ing the coefficient vectors and the EOS codes is pro- 
duced with respect to the 8x8 coefficients in a similar 
manner as step S21 of the above-mentioned second 
enfeoffment whle tracing the zero-tree map. For exam- 
ple, in the case of the 8x8 coefficients shown in 
FIQ20A. since the 2x2 HH coefficients of the level 1 are 
all zero, a vector (0. 0. 0. 0) is produced. Thereafter, the 
upper-left 2x2 HH coefficients are changed into a vec- 
tor. Since a coefficient provided with the ' mark among 
the 2x2 HH coefficients of the level 1 is a root of a zero 
tree, the EOS code is produced and a vector is not pro- 
duced for the four coefficients corresponding to the chil- 
dren thereof. 

[0066] In the subsequent step S52. the on*dimen- 
sionaJ string produced in the previous step is subjected 
to a variable length encoding process using a combma- 
tkxVof an EOS code or a coeff «ient vector that includes 
at least one significant coeff kaent andanuflber of con- 
secutive coefficient vectors immediately preceding the 
coefficient or the EOS code that do not include a signif- 
icant coeff idem. For example, the 8x8 coefficients 
shown in FIG20A are variabKHength encoded as 
shown in FIG21. In a case of the fourth coefficient vec- 
tor from the bottom in FK3.21 . since one coefficient vec- 
tor that does not include a significant coefficient is 
present in the immediately preceding position, the coef- 
ficient vector is encoded as (1 . 1 6. 0. 0. 0). The nurber 
T at the begirding indicates that there is one coeffi- 
cient vector which does not include a significant coeffi- 
cient at the immediately prececfing position. Although 
the Huffman encodng method may be used for encod- 
ing, other variable length encoding methods may be 
used, if necessary. 

P067] The present invention is not limited to the 
above-mentioned examples, but is widely applicable to 
a static image or dynamic image processing apparatus, 
a static image or dynamic image handling equipment 
an information processing apparatus or automation 
equpment as tongas an encodng method of a wavelet 



transform coeff kaent satisfying the scope of the present 
invention is used. 

[Q068] . ..The present invention is not limited to the spe- 
cif icaily disclosed embodiments, but variations and 
5 modifications may be made without departing from the 
scope of the present invention. 
[0069] The present application is based on Japanese 
priority application No.9-359518 filed on December 26. 
1997, the entire contents of which are hereby incorpo- 
io rated by reference. 



Claims 

1. A method tor encoding wavelet transform coeff i- 
i5 cients in an image encodng method in which image 
data is converted and quantized into coefficients by 
a two-dimensional wavelet transform and the coeffi- 
cients having the same spatial position are col- 
lected to form a block so as to encode the 
20 coefficients on an individual Wock basis, 
characterized by the steps of: 

defying a layered quad-tree structure of the 
coefficients included in each block with respect 
2$ to each of a set of coefficients representing a 

veriest component (LH). a set of coefficients 
representing a horizontal component (HL) and 
a set of coefficients representing a diagonal 
component (HH). each quad-tree structure 
30 having a root corresponding to a coefficient ofa 

lowest frequency band; 

searching for a zero tree of which all descend- 
ant nodes lack a significant coefficient 
encoding positional information o* the zero 

35 tree; 

scanning the coefficients other than descend- 
ants of the zero-tree so as to form a one- 
dimensional coefficient string of the scanned 
coefficients; and 
40 encodng the one<fimensicnal coefficient 

string accortfng to a twoKfimensional encodng 
method using a run length of a zero run imme- 
diately prececfing a significant coefficient and a 
significant coefficient 

2. The method as claimed in daiml. characterized by 
the steps of: 

producing a zero-tree map having a layered 
so quad-tree structure corresponcSng to the coeff i- 

dort tree, each node of the zero-tree map indi- 
cating whether or not a corresponding 
coefficient is a root of the zero tree, each node 
being represented by one-Wdata; 
55 scanning the zero-tree map accortfing to a 

depth-first method so as to change the zero- 
tree map into a one-dimensional string of the 
nodes; and 
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producing encoded data of the positional infor- 
mation of the zero-tree map by encoding the 
one-dimensional string of the nodes. 

The method as claimed in c^m 5 
that the one-dimensional string produced from the 
zero-tree map is encoded by a run length encoding 
method. 

The method as claimed in claim 1 . characterized in 10 
that in the scanning step the coefficients other than 
descendants of the zero tree are scanned sepa- 
rately in each of the set of coefficients representing 
the vertical component, the set of coefficients rep- 
resenting the horizontal component and the set of is 
coefficients representing the diagonal component 
according to the depth-first method. 

The method as daimed in daim 4, characterized in 
that the set of confidents representing the vertical 20 
conponent is scanned in an order of upper left 
lower left upper right and lower right the set of 
coeffidents representing the horizontal component 
is seamed in an order of upper left i«>er right 
lower left and lower right and the set of coeffidents 2s 
representing the cfiagonal component is scanned in 
an order of upper left lower right toper right and 
lower left 

A method for encoding wavelet coeffidents in an x 
image encoding method in which image data is 
convaled and quantized into coefficients by a two- 
dimensional wavelet transform and the coeffidents 
having the same spatial position are collected to 
form a block so as to encode the coeffidents on an as 
inefvidual block basis, characterized by the steps 
of: 

def ring a layered quad-tree structure of coeffi- 
cients included in the block with respect to *c 
each of a set of coeffidents representing a ver- 
tical component a set of coeffidents represent- 
ing a horizontal component and a set of 
coeffidents representing a dagonal compo- 
nent each quartered-tree structure having a 45 
root corresponding to a coeffidertt a* a lowest 
frequency band; 

searching for a zero tree of which all descend- 
ant nodes lack a significant coeffident; 
scanning the coeffidents other than descend- so 
ants of the zero tree acconfing to the depth-first 
method, a scanning being separately per- 
fcymed for each of the set of coefficients repre- 
senting the vertical component the set of 
coeffidents representing the horizontal compo- ss 
nent and the set of coeffidents representing 
the dagonal component 
producing a coeffident vector by using tour 



coeffidents of each node of each quartered- 
tree structure and producing an EOS code at a 
root of the zero tree so as to produce a string of 
the coeffident vectors and the EOS codes; and 
encocfing the string of the coeffident vectors 
and the EOS codes by a variable length encod- 
ing method. 

The method as claimed in daim 6, characterized in 
that the set of coeffidents representing the vertical 
conponent is scanned in an order of i*)per left, 
lower left upper right and lower right; the set of 
coeffidents representing the horizontal component 
ts scanned in an order of upper left iwer right, 
lower left aid lower right; and the set of coeffidents 
representing the diagonal component is scanned in 
an order of upper left lower right upper right and 
lower left 

The method as claimed in daim 6 or 7, character- 
ized in that in the encoding step the string of the 
coeffident vectors and the EOS codes is adaptively 
encoded by a variable length encoding based on a 
dass of a degree of a value of a coeffident corre- 
sponcfing to a parent coeffident of the coeffident 
vectors or the EOS code to be encoded. 

The method as daimed in daim 6 or 7. character- 
ized in that in the encoding step the string of the 
coeffidwt vectors and the EOS codes is adaptively 
encoded by a variable length encocfing based on a 
level of a frequency band in which the coeffident or 

the EOS code to be encoded is located 

l The mettod as daimed in daim 6 or 7, character- 
ized in that in the encocfing step the string of the 
coefficient vectors and the EOS codes is adaptively 
encoded by a variable length encoding icing a 
uj iti na bo n of a coeffident vector inctucfrig a sig- 
rvficant coeffident or an EOS code and a number of 
the coefficient vectors each of which lack a signifi- 
cant coeffident 
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FIG.18 
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